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Abstract 

We discuss parametric quasi-maximum likelihood estimation for quadratic ARCH 
process with long memory introduced in Doukhan et al. (2015) and Grublyte and 
Skarnulis (2015) with conditional variance given by a strictly positive quadratic form 
of observable stationary sequence. We prove consistency and asymptotic normality of 
the corresponding QMLE estimates, including the estimate of long memory parameter 
0 < d < 1/2. A simulation study of empirical MSE is included. 
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1 Introduction 

Recently, Doukhan et al. [1] and Grublyte and Skarnulis [5] discussed a class of quadratic 
ARCH models of the form 

OO 

rt = Ctcrt, A = (a-bXhU-j)^+70-f-i, (1.1) 

1=1 

where 7, cu, o, bj , j > 1 are real parameters. In [8] , (jl.ip was called the Generalized Quadratic 
ARCH (GQARCH) model. By iterating the second equation in (II.ip . the squared volatility 
in (jl.ip can be written as a quadratic form 

OO OO 

= X + X 

£=0 3=1 

in lagged variables rt-i,rt- 2 , • • •, and hence it represents a particular case of Sentana’s m 
Quadratic ARCH model with p = 00 . The model (jl.ll) includes the classical Asymmetric 
GARCH(1,1) process of Engle [S] and the Linear ARCH (LARCH) model of Robinson [11] : 

OO 

n = Cto-t, CTt = a + '^bjrt-j. (1.2) 

1=1 


1 


Giraitis et al. [7] proved that the squared stationary solution {r|} of the LARCH model 
in (II.2p with bj decaying as < d < 1/2 may have long memory autocorrelations. 

For the GQARCH model in (II.ip . similar results were established in [3| and [8]. Namely, 
assume that the parameters 'y,LJ,a,bj,j > 1 in satisfy 

bj ~ {3 0 < d < 1/2, c > 0) 

and 

<1-7, 7G[0, 1), a/0, 

where 

OO 

/X4:=ECo^ B2:=Y,b], 

i=i 

and where K 4 is the absolute constant from Rosenthal’s inequality in (12.51) . below. Then 
(see [8], Thm.5) there exists a stationary solution of (II.ip with Er/ < 00 such that 

cov(rQ,r/) ~ t —>• OO 


and 

[nr] 

-Er/) -^d[o,i] «^2Wrf+(i/2)(r), n 00 , 

t=i 

where Hd+(i/2) is a fractional Brownian motion with Hurst parameter H = d + (1/2) € 
(1/2,1) and «;* > 0, i = 1, 2 are some constants; ^_d[o,i] stands for the weak convergence in 
the Skorohod space Z1[0,1]. 

As noted in [3], [8], the GQARCH model of (11.11) and the LARCH model of (II.2p have 
similar long memory and leverage properties and both can be used for modelling of financial 
data with the above properties. The main disadvantage of the latter model vs. the former 
one seems to be the fact that volatility at in (jl.2p may assume negative values and is not 
separated from below by positive constant c > 0 as in the case of m- The standard quasi¬ 
maximum likelihood (QML) approach to estimation of LARCH parameters is inconsistent 
and other estimation methods were developed in Beran and Schiitzner [T], Francq and 
Zakoian [^, Levine et al. [9], Truquet M- 

The present paper discusses QML estimation for the 5-parametric GQARCH model 

OO OO 

£=0 j=l 

depending on parameter 9 = (7, w, a, d, c), 0 < 7 < l,a; > 0,a / 0, c / 0 and d G (0,1/2). 
The parametric form bj = of moving-average coefficients in is the same as 

in Beran and Schiitzner [T] for the LARCH model. Similarly as in [T] we discuss the 
QML estimator := argmin^ee Ln(6'), Ln{9) := 7 SLi (^)) involving exact 

conditional variance in dop depending on inhnite past r*, — 00 < s < t, and its more 
realistic version 6n ■= argmin^g© Ln{9), obtained by replacing the (t/(0)’s in (II. 3p by u/(0) 
depending only rg,! < s < t (see Sec. 3 for the definition). It should be noted that the 
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QML function in [T] is modified to avoid the degeneracy of in (11.21) . by introducing 
an additional tuning parameter e > 0 which affects the performance of the estimator and 
whose choice is a non-trivial task. For the GQARCH model (II.3p with a; > 0 the above 
degeneracy problem does not occur and we deal with unmodified QMLE in contrast to [T]. 
We also note that our proofs use different techniques from [T]. Particularly, the method of 
orthogonal Volterra expansions of the LARCH model used in [T] is not applicable for model 
D ; see m, Example 1). 

This paper is organized as follows. Sec. 2 presents some results of [8] about the existence 
and properties of stationary solution of the GQARCH equations in (|l.ll) . In Sec. 3 we 
define several QMLE estimators of parameter 9 in (II.3p . Sec. 4 presents the main results of 
the paper devoted to consistency and asymptotic normality of the QML estimators. Einite 
sample performance of these estimators is investigated in the simulation study of Sec. 5. 
All proofs are relegated to Sec. 6. 

2 Properties of stationary solution 

In this sec. we recall some facts from [5] about stationary solution of dni). Eirst, we give 
the dehnition of it. Let Tt = o'(Q, s < t), t G Z be the sigma-field generated hy Cs, s < t. 

Definition 2.1 By stationary solution of (11.11) we mean a stationary and ergodic martin¬ 
gale difference sequence {rt,J't,t € Z} with Er| < oo, E[rf |Tt_i] = af such that for any 
t G Z the series Xt := btsCs converges in L^, the series 
converges in and ([HD holds. 

Eor real p >2, define 

OO 

V(l-7). (2.4) 

i=i 

We use the following moment inequality. 

Proposition 2.2 Letp > 2 and {Yj} be a martingale difference sequence such that E|L) |^’ < 
oo; E[Yj\Yi, ■ ■ ■ ,L)-i] = 0, j = 2,3,-'' . Then there exists a constant Kp depending only 
on p and such that 

OO OO 

e\j 2 yj\^ < ( 2 - 5 ) 

i=i i=i 

Remark 2.3 Inequality (j2.5p is trivial for p = 2, K 2 = 1. Eor p > 2, (123]) is a consequence 
of the Burkholder and Rosenthal inequality (see 0, m)- Osqkowski [T0| proved that 
< 4(| -h -k iog{p/ 2 ) )^ ™ particular, < 32.207. 

Proposition 2.4 ([8]) Let 7 G [0,1) and {Q} be an i.i.d. sequence with zero mean and 
\p\p := E|((oP < 00 for some p >2. Assume that 

KplffpBp^-^ < 1 , ( 2 . 6 ) 
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where is defined in (12.41) and Kp is the absolute constant in ([23]). Then there exists a 
unique stationary solution {r^} of (jl.ip such that the series = YlJLi conuerges in 

LP and 

E\rt\P<Cil + E\Xtn and E|X,|p < , „ , 

where C > 0 is a constant independent o/{ 6 j},p, 7 , and the distribution of (q. Moreover, 
for p = 2 condition (1231) j or 

00 

= (2.7) 

i=i 

is necessary for the existence of a stationary L'^-solution of O)- 

3 QML estimators 

The following assumptions on the parametric GQARCH model in (II.3p are imposed. 
Assumption (A) {('t} is a standardized i.i.d. sequence with = 0,E^| = 1. 
Assumption (B) 0 C is a compact set of parameters 6 = {'j,uj,a,d,c) defined by 

(i) 7 G [ 71 , 72 ] with 0 < 71 < 72 < 1 ; 

(ii) LJ G [a;i,a; 2 ] with 0 < wi < 012 < 00 ; 

(hi) o G [oi, 02 ] with —00 < ui < 02 < 00 ; 

(iv) d G [^ 1 ,^ 2 ] with 0 < di < ^2 < 1/2; 

(v) c G [ci, C 2 ] with 0 < Cj = Ci{d, 7 ) < 00 , ci < C 2 such that B 2 = c^ <1 — 7 

for any c G [ci,C 2],7 G [ 71 , 72 ],^ G [di,d 2 ]. 

We assume that the observations {rj, 1 < t < n} follow the model in (jl.ip with the true 
parameter Oq = ( 70 , wq, ao, cq) belonging to the interior ©o of 0 in Assumption (B). The 
restriction on parameter c in (v) is due to condition (12.71) . The QML estimator of 0 G 0 is 
defined as 

9n ■■= argminL„( 6 () (3.8) 

0G0 

where 

1 71 2 

and < 7 /( 0 ) is dehned in (|1.3p . viz., 

00 

(jI{9) = ^ 7 ^{a;^ + (a + cl^_£(d))^}, where (3.10) 

£=0 

00 

Yfid) := 

1=1 
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Note the definitions in (j3.8l) - (l3.10p depend on (unobserved) rs,s < 0 and therefore the 
estimator in (13.8p is usually referred to as the QMLE given infinite past [T]. A more 
realistic version of (j3.8p is defined as 

6 n ■■= argminZ„(6'), (3.11) 

where 

-i 2 

Ln{0) := where (3.12) 

^ \^) ' 

t-1 t-1 

•= + {a + cyt-i{d)f], Yt{d) := 

£=o i=i 

Note all quantities in (I3.12p depend only on r^, 1 < t < n, hence (13.lip is called the QMLE 
given finite past. The QML functions in p3.9p and p3.12p can be written as 

- n 1 ^ 

Ln{0) =-Y^ltiO) and Ln{e) = -y^Tt{e), 

” t=l ^ t=l 

respectively, where 

2 2 

•= ^7^ (^)’ (^)- (3-13) 

\ 0 ) \ 0 ) 

Einally, following [T] we define a truncated version of (13.lip involving the last 0{n^) quasi¬ 
likelihoods lt{0),n — [nd] < t < n, as follows: 

aigmin■= yT] 
eee 

t=n—[nl^]+l 

where 0 < /3 < 1 is a ‘bandwidth parameter’. Note that for any t G Z and 9q = 
('fo,uJo,ao,do,co) G 0, the random functions Yt{d) and Yt{d) in p3.10p and (I3.12p are in¬ 
finitely differentiable w.r.t. d G (0,1/2) a.s. Hence using the explicit form of erf {6) and 
df{6), it follows that af{9),'df{6),lt{9),lt{6),Ln{0),Ln{6),L^\6) etc. are all infinitely dif¬ 
ferentiable w.r.t. 0 G ©0 a.s. We use the notation 

L{9) := EL„(0) = ^lt{9) (3.15) 

and 

A{9) := E [V^lt{9)Vlt{9)\ and B{9) := E [V^V/i(0)] , (3.16) 

where V = [d/d9i, - ■ ■ ,d/d9^) and the superscript T stands for transposed vector. Par¬ 
ticularly, A{9) and B{9) are 5 x 5-matrices. By Lemma l4.ll the expectations in (j3.16l) are 
well-defined for any 0 G 0 under condition Er^ < oo. We have 

B{9) = E[a^\9)V'^af{9)Vaf{9)] and A{9) = KiB{9) (3.17) 

where K4 := E(Co — 1)^ > 0. 
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4 Main results 


Everywhere in this section {r^} is a stationary solution of model (11.31) as defined in Defi¬ 
nition [Q and satisfying Assumptions (A) and (B) of the previous section. As usual, all 
expectations are taken with respect to the true value 6 q = (70, wq, oq, do) cq) € ©o, where 
©0 is the interior of the parameter set © C M^. 

Theorem 4.1 (i) Let E|rtp < 00 . Then On in (13.8p is a strongly consistent estimator of 
Oq, i.e. 

On “4- do- 

(ii) Let E|rt|® < 00 . Then On in (13.8j) is asymptotically normal: 

'4 iV(0,S(do)), (4.18) 

where S(do) := B~^{Oo)A{0q)B~^{Oo) = H4^B~^{0 q) and matrices A{0),B{0) are defined in 

dam). 

The following theorem gives asymptotic properties of ‘hnite past’ estimators On and On'^ 
defined in (j3.11l) and (j3.14l) . respectively. 

Theorem 4.2 (i) Let E|rfp < 00 and 0 < fi < 1. Then 

E\dn-Oo\ 0 and - 0 q\ 0. 

(ii) Let E|rt|® < 00 and 0 < /3 < 1 — 2do- Then 

nh/^{ 0 iJ»-O^) 4 N{O,T{0o)), (4.19) 

where E(0o) is the same as in Theorem \4-l[ 

The asymptotic results in Theorems 14.11 and 14.21 are similar to the results of ([T], Thm. 
1-4) pertaining to the 3-parametric LARCH model in (11.21) with bj = except that [T] 

deal with a modified QMLE involving a ‘tuning parameter’ e > 0. Theorems 14.II and 14.21 are 
based on subsequent Lemmas 14.1114.41 which describe properties of the likelihood processes 
defined in (13.91) . (I3.12P and (13.131) . As noted in Sec. 1, our proofs use different techniques 
from [T] which rely on explicit Volterra series representation of stationary solution of the 
LARCH model. 

Eor multi-index i = (ii, • • • , 15 ) € N®, i 7 ^ 0 = (0, • • • , 0), |i| := ii is, denote 

partial derivative (9* := 0^=1 

Lemma 4.1 Let E\rt\‘^~^^ < 00 , for some integer p > 1. Then for any i € N^, 0 < |i| < p, 

Esup |9*Zi(d)| < 00 . (4.20) 

eee 

Moreover, if E\rt\‘^~^^~^^ < 00 for some e > 0 and p € N then for any i € N®, 0 < |i| < p 

Esup |9*(Zt(0) — Zt(d))| —0, t —)• 00 . (4-21) 

eee 
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Lemma 4.2 The function L{9),6 ^ Q in (13.151) is bounded and continuous. Moreover, it 
attains its unique minimum at 6 = 9 q. 

Lemma 4.3 Let Er^ < cx3. Then matrices A{9) and B{9) in (I3.16P are well-defined and 
strictly positive definite for any 0 € 0. 

Write I • I for the Euclidean norm in and in (8) (the matrix norm). 


Lemma 4.4 (i) Let E|rtp < oo. Then 

sup\Ln{9) - L{9)\ “4' 0 and Esup |L„(0) - L„(0)| ^ 0. (4.22) 

dee dee 

(a) Let Erf < oo. Then VL(0) = EVlt{9) and 

sup\VLn{9) -VL{9)\ 4 0 and Esup |VL„(0) - vZ„(0)| ^ 0. (4.23) 

dee dee 

(in) Let E\rtf < oo. Then V^VL{9) = EV^Vifid) = B{9) (see (IXTHI) ) and 

sup0g0|V^VL„(0)-V^VL(0)| “4- 0, (4.24) 

Esup0ge|V^VL„(0)-V^VL„(0)| ^ 0. (4.25) 


5 Simulation study 

In this section we present a short simulation study of the performance of the QMLE for the 
GQARCH model in (jl.3l) . The GQARCH model in (11.31) was simulated with i.i.d. standard 
normal innovations {Ct}- The QMLE procedure was evaluated for medium-term (re = 1000) 
and long-term (re = 5000) samples. The process was generated for —re < t < n using the 
recurrent formula in (jl.ip with appropriately truncated sum initial 

condition U-n-i = 0. The QMLE estimation used generated time series r*, 1 < t < re with 
ft, —n < t < 0 as the pre-sample. The numerical optimization procedure minimized the 
QML function: 



with 

n 

n = Ct(fu = 4 + {a +c'^f-^rt-jY+ t = l,---,re. 

i=i 

Einite-sample performance of the QML estimator is studied for fixed values of parameters 
7 o = 0.7, ao = —0.2, Co = 0.2 and different values of uq = 0.1,0.01,0.001 and the long 
memory parameter do = 0.1, 0.2,0.3, 0.4. The above choice of 9 ^ = ( 70 , wq, oq, cq, do) can 
be explained by the observation that the QML estimation of 7 o,ao,co appears to be more 
accurate and stable in comparison with estimation of ojq and do- The very small values of 
ojQ in our experiment reflect the fact that in most real data studied by us, the estimated 
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QML value of coq was less than 0.05. The presence of wq > 0 in the GQARCH model in 
()1.3I) is very important for consistency of the QMLE procedure, by guaranteeing that erf (0) 
is separated from zero. A similar role is played by the ‘tuning parameter’ e > 0 in the 
LARCH estimation in [T], except that wq > 0 is estimated in ()1.3p and not ad hoc imposed 
as e > 0 in [T]. 

The numerical QML minimization was performed using the MATLAB language for tech¬ 
nical computing, under the following constraints: 

0.001 < 7 < 0.9, 0<a;<2, -2<a<2, 0<(i< 0.5, (5.26) 

(0.05 - 7 ) V ( 7 / 999 ) < c^Ci2{l - d)) < (0.99 - 7 ) A ( 997 ), 

where ^(-2^) = is the Riemann zeta function. The last constraint in (I5.26P guaran¬ 

tees Assumption (B) (v) with appropriate 0 < Ci{d,'y),i = 1,2. 

The results of the simulation experiment are presented in Table 1, which shows the 
sample R(oot)MSEs of the QML estimates On = {jn,(^n,an,Cn,dn) with 100 independent 
replications, for two sample lengths n = 1000 and n = 5000 and the above choices of 
^0 = ( 70 ) wojoojC o,do)- Our observations from Table 1 are summarized below. 

1. All RMSEs decrease as n increases. The convergence rate of estimates seems quite 
good overall. 

2. Parameter 70 is estimated rather accurately. E.g., for n = 5000 RMSE( 7 „) is very 
stable for all values of ujq and do- 

3. The previous conclusion generally applies also to the QML estimates dn,Cn and dn 
except that their RMSE markedly increases when do = 0.4. 

4. The QML estimate of ujq < 0.01 seems to have a ‘constant’ bias ~ 0.02 ^ 0.03 for all 
values of do with n = 5000. 


6 Proofs 


Proof of Lemma \4.1\ We use the following (Faa di Bruno) differentiation rule: 

9A,-"(9) = Y. (6.27) 

y=l j^+...+j^=i k=l 

\i\ y 

aMogfj/(d) = ^(-i)^"Hi/-i)!fji“2^(d) 

ji+-+3.='i 


v=l 


k=l 


where the sum ^_, a is taken over decompositions of i into a sum of v multi- 

indices 7 ^ 0, A: = 1, • - - , and is a combinatorial factor depending only on 

«/ 1’* ’•/ iz 

3k^ l<k<v. 
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Let us prove (14.201) . We have \d'^lt{9)\ < ^(0)| + log cj^( 0)|. Hence using (|6.27l) 

and the fact that cr^{0) > — 7 ) > w^/(l — 72 ) > 0 we obtain 


1*1 


sup 

0G0 






060 


Therefore by Holder’s inequality 


Esup|a*/t(0)| < C(E(r2 + 1)(2 +p)/2)2/(2+p) 

060 

1*1 


^ ^ 06© 


Qk 


(6.28) 




where l/^j < p/(2 +p)- Note |i| = Yl'k=i l^fcl hence the choice qu = (2 +p)/\3k\ 
satishes Yl'j=i — X]fc=i |j'fcl/(2+p) < p/(2+p). Using (|6.28l) and condition E|rip+P < 
C, relation (|4.20l) follows from 


Esup(|a-?af( 0 )|M( 0 ))^"+'’^/'^' < 00 

06 © 

for any multi-index j G N^, 1 < IjI <P- 
Consider hrst the case \j\ - 
We have 


(6.29) 


dial {9) = < 


or the partial derivative diaf{9) 

= daf{9)/d9i, 1 < i < 5. 

:^1 + {a + cYt_i{d))‘^}, 

Y 

II 

.“ 0 ^ 20 ;, 

9i = uj, 

:^Q7^2(a -b cYt-e{d)), 

9, = a, (6.30) 

T=ol%a + cYt_iid))Yt_,id), 

9i = c, 

:^^o7'2c(a + cYtAd))ddYt-e{d), 

II 


We claim that there exist C'>0, 0 < 7<1 such that 


sup I 
060 




< C{1 +Jtfi +Jtp), i = l,-",5, where 


(6.31) 


Jtfi '■= sup \Yt-i,{d)l Jt,i ■= ^ 7 ^ sup \ddYt-e{d)\- 

^_Q dG[di,d2] £.=0 d^\d\A2\ 

Consider (I6.3ip for 9i = 7 . Using for all .£ > 1,7 G [ 71 , 72 ] C (0,1) and 

some C>0, 0 < 7<1 together with Assumption (B) and Cauchy inequality, we obtain 

(a + cUt_£(d))^)^^^ < C{l + Jtfi) uniformly in 0 G 0, 
proving (I6.3ip for 9i = 7 . Similarly, \dca1{9)\/at{9) < C{1 + Jtfi) and |(9d(Tj (6()|/at(6() < 
(7(1 -I- Einally, for 9i = oj and 9i = a, (I6.3ip is immediate from ()6.30p . proving (I6.3ip . 
With ()6.3ip in mind, ()6.29p for |j| = 1 follows from 


EJIA = E(J^7' sup \d^Yt_,{d)\)^+^ < cx), i = 0 ,l. 
£=0 <i£[di,d2] 


(6.32) 
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Using Minkowski’s inequality and stationarity of {Yt{d)} we obtain 

eV(2+p) suprf |5^yi_,(d)|2+P < C(Esuprf |9*yi(d)|2+P)V(2+P)^ ^here i 

Hence using (m , Lemma 1 (b)) and the inequality xy < x‘^/q+y‘^ /q', x,y > 0,1/q+l/q' = 1 

we obtain 




1 

< U^E sup \d^Yt{d)f+P 

j^Q de[di,d2] 

2 

< sup E\diiYt{d)\‘^+P < oo 

j^Q dG[di,(i2] 


(6.33) 


sincesnp,,|,,,,,|E|8jy.(<i)p+I><C5up,j[*,*|(E“i(9j/-‘)"(E|n_jf+''f-'P+'’))'"+’’>''"< 
cx) according to condition E|rtp"''^' < C, Rosenthal’s inequality in (I2.5p and the fact that 
s^Pd&[d^,d 2 ]T.T=i(^df~^f < supde[dp,d 2 ] + log^j)^ < C,i = 0,1,2. This 

proves (16.291) for \j\ = 1. 

The proof of (I6.29P for 2 < |j| < p is simpler since it reduces to 


Esup IS-^'cTj < oo, 2<\j\<p. (6.34) 

eee 


Recall = yand j' := ji-(ji, 0, 0,0, 0) = (0, j2, Js, j4, js)- If j' = Othensup^gQ \d^a‘^{6)\ < 
CJtfi follows as in (I6.3ip implying (I6.34p as in p6.33p above. Next, let j' / 0. Denote 

Ql{9) := a;2 + (a + cYt{d)f (6.35) 

so that (Tt{6) = have with m := ji > 0 that \d^ a‘l{9)\ < 

m)!) 7 ^“”’’ \d^ Q'l_(^{9)\ and p6.29p follows from 

Esup < oo. (6.36) 

0G0 

For j2 7^ 0 (recall 02 = the derivative in (|6.36l) is trivial so that it suffices to check (16.361) 
for ji = 0 only. Then applying Faa di Bruno’s rule we get 

|a-^g2(0)|(p+2)/2 < ^ ^cyt(d))|(p+2)/2|a-?2(a + cYt{d))\^p+'^'^/‘^ 

3 i + 32=3 

and hence (I6.36P reduces to 

Esup IclJ'(a + cy)((i))|^^^ < oo, 0 <|jf|<p, 

060 

whose proof is similar to (I6.32p above. This ends the proof of (l4.2Up . 

The proof of (14.211) is similar. We have \d'^{lt{9) — lt{9))\ < rf |c 1*((T("^(0) — Uj“^(0))| + 
|9*(log(T|(0) — loguf(0))|. Hence, using Holder’s inequality similarly as in the proof (|4.2UI) 
it suffices to show 

Esup |(9*((T^^(0) — cfj“^(0))|~ —)• 0 and Esup (log0-4(0) — logu^(0))|~ ^ 0.(6.37) 
0G0 0e0 
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Below, we prove the first relation in (16.371) only, the proof of the second one being analogous. 
Using the differentiation rule in (I6.27P we have that 


\i\ . . _ . . 

where 

if/'-'^"(9) 


Whence, (I6.37P follows from 

sup\W^^’"'’^‘'{e) 0, t^oo (6.38) 

0g0 

and 

Esup(|w/i’'"’^'‘'(0)| + |w/i’'"’^'‘'(0)|)^^+^+"^/^ < C<oo (6.39) 

0ee 

for some constants e > 0 and C > 0 independent of t. In turn, (16.381) and (|6.39l) follow from 

sup |(9'^'((7 j (0) — CTj (0))| —0, too (6.40) 

dee 

and 

Esup(|a-?cJt^(0)|/(Jt(0))^^+^+^^/'-^’' < C, (6.41) 

dee 

Esup(|a-?5t2(0)|/5t(0))^^+^+^^/'-^’' < C, 
dee 

for any multi-index j such that |jf| >0 and 1 < |j| < p, respectively. 

Using condition E|rtp'’'^+'^ < C, relations in (I6.4ip can be proved analogously to (|6.29p 
and we omit the details. Consider (j6.40p . Split erf(0) — uf(^) = Ut,i{0) + Ut, 2 {d), where 

t-i 

Ut,m ■■= ^ 7 '{(a + cyt_,(d))"-(a + cl)_,(d))'}, (6.42) 

i=l 

oo 

Ut,2{0) ■■= ^7^{a;2 + (a + cyt_,(d))"}. 

£=t 

Then supq^q \d^Ut,i{6)\ —7>p 0,t —>■ oo,z = 1,2 follows by using Assumption (B) and 
considering the bounds on the derivatives as in the proof of (I6.29p . For instance, let us prove 
« for = dd, \j\ = 1. We have \ddUt,i{e)\ < + \%-iid)\)\ddiYt_,id) - 

Yt_i{d))\ \ddYt_i{d)\\Yt_i{d) - Yt_e{d)\}- Hence, sup^ge |(9rfUt4(6')| ^p 0 follows from 
0 < 7 < 72 < 1 and 

E sup {\Yt{d)-Yt{d)f+ \dd{Yt{d)-Yt{d))f) ^ 0 and (6.43) 

de[di,d2] 

E sup {\Yt{d)\^ + \Ytid)\^ + \ddYt{d)f + \dd%{d)\^) < C. (6.44) 

de[di,d2] 
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The proof of (16.441) mimics that of (16.331) and therefore is omitted. To show (16.431) . note 
Yt{d) —Yt{d) = ^ similar argument as in ()6.33p to show that the l.h.s. 

of dSai]) does not exceed Y.l=o^d^d 0 ^t{d)-%{d))\^ < Csup^gj^^^^^] 

(1 + log^ j) ^ 0 (t —>■ oo). This proves (I6.40p for \j\ = 1 and = d^- The remaining cases 
in (I6.40p follow similarly and we omit the details. This proves p4.2ip and completes the 
proof of Lemma 14.11 □ 


Proof of Lemma \4^ We have \L{0i) — L(02)| < Y\lt{0i) — lt{02)\ < CY\a1{9i) — (Tf(02)|, 
where the last expectation can be easily shown to vanish as \6i — 02 1 0, 0i, 02 £ ©• This 

proves the first statement of the lemma. To show the second statement of the lemma, write 


L(0)-L(0o) = 


E[ 




log 




!]• 


The function f{x) := x — 1 — logx > 0 for x > 0, x 7 ^ 1 and /(x) = 0 if and only if x = 1. 
Therefore L{6) > L{6q),\/9 € 0 while L(0) = T(0o) is equivalent to 


= (tI{9o) (Peo-a.s.) 


(6.45) 


Thus, it remains to show that (I6.45P implies 0 = 0o = ( 70 , wo; « 0 ) <^ 0 ; co)- Consider the 
‘projection’ Pgf, = E[,^|T's] — E[,^|T's_i] of r.v. '^,E|^| < 00 , where Fs = <j{Cu,u < s) (see 
sec.2). (j6.45l) implies 

0 = PsiaUO) - fT?(0o)) = PsiQUO) - QUOo)) + (7 - 7o)^.cTt-i(0o), V s < t - 1, (6.46) 
where Qti^) = + (a + same as in f|6.35p . We have 

^sQt (^) — ^ ^ E I’lMpyi (6.47) 

u<s s<u<t 

= 2abt-s{9)CsCrs{9o) + 2bt-s{9)CsCrs{9o) ^ bt-u{9)ru 

U<S 

+ hl_^{9)Psal{9o) + hl_,{9){Cl - l)al{9o). 

S<U<t 

Whence and from p6.46l) for s = t — 1 using Pt-ia^_i{9o) = 0 we obtain 

Ci(0,0o)CEi + 2C2(0,0o)Ct-i - Ci(0,0o) = 0 (6.48) 

where 

Ci(0,0o) := {c^-cl)at_,i9o), 

C2(0,0o) := (ac-aoCo)+ (c^it - - cl{t - uf°~^)ru. 

U<t — 1 

Since Ci{9,9Q),i = 1,2 are Ti_ 2 -measurable, (j6.48l) implies Ci{9,9q) = (72(0,00) = 0, 
particularly, c = cq since cJt_i(0o) > w > 0. Then 0 = (72(0, 0o) = co(a—ao)+CQ 
u)^~^ — {t — u)^°~^)ru and Er„ = 0 lead to a = oq and next to 0 = E(E„<t_i((^ — ~{'t — 

uy°~^)ruf = Er^ Ej> 2 (/"^ _jdo-if2 ^ ^ ^ Consequently, Ps{Ql{9) - Ql{9o)) = 
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0 for any s < f — 1 and hence 7 = 70 in view of (16.461) . Finally, oo = uq follows from 
Ecj|( 6 () = Ecj|(0o) and the fact that w > 0,t<;o > 0. This proves 0 = 6q and the lemma, too. 
□ 


Proof of Lema 4-S. From (j3.17p . it suffices to show that 


S/al{e)\^ = 0 


(6.49) 


for some 9 € Q and A € M®, A 7 ^ 0 leads to a contradiction. To the last end, we use a similar 

projection argument as in the proof of Lemma l4.2l First, note that cr^{9) = 

implies 

Va2(0) = (0, V4Q?(0)) + 7Va2_i(0) + (V7)a2_,(0), 

where V 4 = {d/92, - ■ ■ , d9f). Hence and using the fact that (j6.49l) holds for any t G Z by 
stationarity, from (16.491) we obtain 

(fT?_i(0),V4Q?(0))A^ = O. (6.50) 


Thus, 

{PsatM.Ps^lQKe)))^ = 0 , Vs<t-1; 

c.f. (j6.46D . For s = t — 1 using Pt-ia‘/:_i{9) = 0, Pt-fS/^Ql{9) = V4^Pt-iQl{9) by differen¬ 
tiating (I6.47P similarly to (I6.48P we obtain 

D^{X)Cti + ‘^D2{\)Qt-i - Di{\) = 0 (6.51) 

where Hi (A) := 2\^at-i{9) and 

D 2 {\) := A3C + Asa -h 2A5C- uY~'^ru + A 4 C^ Y.u<t-i{^ “ 

A = (Ai,--- ,A 5 )^. As in p6.48p . Di{X),i = 1,2 are J7_2-measurable, (16.511) implying 
Di{X) = 0,i = 1,2. Hence, A5 = 0 and then D 2 {X) = 0 reduces to A3C-I- A4C^^^^^_^(t — 
n)'^“^ log(t — u)ru = 0. By taking expectation and using c / 0 we get A3 = 0 and then 
A4 = 0 since E(^^^j_^(t — uY~‘^ log(t — u)ru)‘^ / 0- The above facts allow to rewrite p6.50p 
as 2 wA 2 + Xia‘/‘_i{9) = 0. Unless both Ai, A2 vanish, the last equation means that either 
Ai / 0 and {a'‘l{9)} is a deterministic process which contradicts c / 0, or Ai = 0, A2 7^ 0 
and a; = 0, which contradicts a; 7^ 0. Lemma 14.31 is proved. □ 

Proof of Lemma \4.4\ Consider the first relation in (I4.22p . The pointwise convergence 
Ln{9) T 7 ' L{9) follows by ergodicity of {lt{9)} and the uniform convergence in (14.221) from 
Esupgg 0 \\/lt{9)\ < 00 , c.f. ([T], proof of Lemma 3), which in turn follows from of Lemma 
14.11 (j4.20p with p = 1. The proof of the second relation in (I4.22p is immediate from Lemma 
14.11 (j4.2ip with p = 0, e = 1. The proof of the statements (ii) and (iii) using Lemma l4.1l is 
similar and is omitted. □ 

Proof of Theorem 14-1\ (i) Follows from Lemmas 14.21 and 14.41 (il using standard argument, 
(ii) By Taylor’s expansion, 

0 = VLn(9n) = VLn{9o) + V^VLn{9*J{9n - 9o), 
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where 0* —>-p 9q since On —>-p 6q. Then Ln{On) —V^VL(6*o) by Lemma [13] (14.241) . 
Next, since {r|/cr|(0o) —I, S Z} is a square-integrable and ergodic martingale difference 
sequence, the convergence A{9q)) follows by the martingale central 

limit theorem in ([2], Thm.23.1). Then (|4.18p follows by Slutsky’s theorem and (|3.16p . □ 

Proof of Theorem \4-^ Part (i) follows from Lemmas l4.2l and l4.4l fil as in the case of Theorem 
lom. To prove part (ii), by Taylor’s expansion 

where 0* ^p 9q since ^►p Oq. Then V^VL^f^(0*) —^p V'^VL(0o) by Lemma 1131 (|4.241) - 
(|4.25l) . From the proof of Theorem 14.11 (ii) we have that ^{0, A{9o)), 

where L^\9) := i^Y^^=n-[nP]+i^i^^)■ Hence, the central limit theorem in (I4.19P follows 
from 

4(/3) :=E|VLW(0o)-VLi^)(0o)| = o{n-f^/^). (6.52) 

We have /n(/3) < sup„_[„^]<^<„E|V/4(0o) “ '^h{9o)\ and (|6.52l) follows from 

E\S/k{9o)-S/k{9o)\ = o(t-^/2), t^oo. (6.53) 


Write ll^llp := for L^-norm of r.v. f. Using \V{lt{9o) — /t(0o))| < |3(o')“^(0o) — 

af‘^{9o))\ -|- |V(log(7j (0o) ~loga|(0o))| and assumption E|rt|^ < oo, relation (|6.53l) follows 
from 


= 0{t^° ^^^logt) and (6.54) 

ht'^diat - af^diatWi = 0(t'^°"H2 i = !,■■■ ,5, 


where erf := af{9o), erf := erf(0o), Sjerf := dia^{9o), dia^ := dia^{9o). Below, we prove the 
first relation (|6.54p only, the proof of the second one being similar. We have aff^diaf — 
= cj 4 "^ai"^(af-h<Tf)(af-cjf)( 9 ierf-F 5 “'^( 9 jCj 2 - 9 iaf). Then using cjf > a;f/(l- 72 ) > 
0,5f > wf/(l — 72 ) > 0, relation the first relation in (|6.54p follows from 


Wi^t -(^t){di(rt/(Tt)h/3 = 0(i'^° ^/^) and (6.55) 

l|9i(jf-5iaf||5/3 = i = l,---,5. (6.56) 


Consider (16.551). Bv Holder’s ineoualitv. ||lerf — erf 119,er?/erH||K /q < ||erf — erf ||k/ o||9i 
where HSjerf/eriHs < C according to (|6.29l) . Hence, (|6.55p follows from 


ht-^th/2 = 0(i"°-'/2). (6.57) 

To show (|6.57l) . similarly as in the proof of (I6.40p split = Ut^i + where 

Ut,i ■■= Ut,i{9o)A = 1,2 are defined in (I6.42D . i.e., Ut,i = TdZlloHao + coYt-i)'^ - (ao + 
coVt-^)^}, Utfi = + (®o + coYt-ff] and Yt := Yt{do),Yt := Yt{do). We have 

\Ut,i\ < CZtho\Yt-t - + \Yt-e\ + |Ei_,|), \Ut, 2 \ < CZZt7^i^ + \Yt-e?) and 
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hence 


£—1 OO 

Ik? “ '^?ll5/2 < C*! ^7o||(yi_£ — + \Yt-l\ + |li_£|)||5/2 + ^7o(l + ll'^-^lls)! 

l=\ l=t 

£—1 OO 

< c{Y,lo\\yt-e-Yt.eh + Y.^i}, (6.58) 

£=1 l=t 

where we used the fact that ||y )||5 < C, HhiHs < C by llr^Hs < C and Rosenthal’s inequality 
in ()2.5p . In a similar way from (|2.5p it follows that 

\\Yt-i-Yt-ih < C-j E (6.59) 

j>t-e 

Substituting (|6.59l) into (I6.58P we obtain 

£—1 OO 

lk?-5?ll5/2 < C-{E7ki-^k“-'/' + E^o} = 

e=i £=t 

proving ()6.57p . 

It remains to show ()6.56p . Similarly as above, 9jcrf — = diUt^i + diUt^ 2 , where 

diUt,j '■= diUtj{0Q), j = 1,2. Then (I6.56h follows from 

\\diUt,i\\ 5/3 = log t) and \\diUt, 2 h /3 = i = l,---,5. (6.60) 

For i = I, the proof of (lO.OOp is similar to ()6.58p . Consider (I6.60h for 2 < i < 5. Denote 
Vt{e) := 2a + c{Yt{d) + Yt{d)), Vt := Vt{eo),diVt := diVtiOo), then 

t-i 

\\diUt,l\\5/3 < CE7o{lk*(^t-£-?i-kll5||^t||5 + ri-£-?t-£||5|k*Ri||5}, 

e=i 

where di{Yt-e - Yt-i) = 0,/ dd and 

\\dd{Yt-Yt)\\^ = ||^/°“klogj>i_j||5 

j>t 

< = o(k°"^/^iogt) 

j>t 

similarly as in (j6.59p above. Hence, the first relation in (|6.60p follows from (j6.59p and 
IkiVtIls < C{1 + ||(9dyt_£||5 + lls) < (7 < OO as in the proof of (I6.56p . and the proof 

of the second relation in (j6.60p is analogous. This proves ()6.53p and completes the proof of 
Theorem 14.21 □ 


Acknowledgement 

This research was supported in part by grant MIP-063/2013 from the Research Council of 
Lithuania. 


15 



























References 


[1] Beran, J., Schiitzner, M., 2009. On approximate pseudo-maximum likelihood estimation for LARCH- 
processes. Bernoulli, 15, 1057-1081. 

[2] Billingsley, P., 1968. Convergence of Probability Measures. New York: Wiley. 

[3] Burkholder, D.L., 1973. Distribution functions inequalities for martingales. Ann. Probab., 1, 19-42. 

[4] Doukhan, P., Grublyte, L, Surgailis, D., 2014. A nonlinear model for long memory conditional het- 
eroscedasticity. Preprint. Available at arXiv: 1502.00095 [math.ST] 

[5] Engle, R.F., 1990. Stock volatility and the crash of ’87. Discussion. Rev. Financial Studies 3, 103-106. 

[6] Francq, C., Zakoian, J.-M., 2010. Inconsistency of the MLE and inference based on weighted LS for 
LARCH models. J. Econometrics 159, 151-165. 

[7] Giraitis, L., Robinson, P.M., Surgailis, D., 2000. A model for long memory conditional heteroskedas- 
ticity. Ann. Appl. Probab., 10, 1002-1024. 

[8] Grublyte, I., Skarnulis, A., 2015. A generalized nonlinear model for long memory conditional het- 
eroscedasticity. Preprint. Available at arXiv:1509.01708 [math.ST] 

[9] Levine, M., Torres, S., Viens, F., 2009. Estimation for the long-memory parameter in LARGH models, 
and fractional Brownian motion. Stat. Inf. Stoch. Process. 12, 221-250. 

[10] Os§kowski, A., 2012. A note on Burkholder-Rosenthal inequality. Bull. Polish Acad. Sci. Mathematics 
60, 177-185. 

[11] Robinson, P.M., 1991. Testing for strong serial correlation and dynamic conditional heteroskedasticity 
in multiple regression. J. Econometrics, 47, 67-84. 

[12] Rosenthal, H.P., 1970. On the subspaces of L^{p > 2) spanned by the sequences of independent random 
variables. Israel J. Math., 8, 273-303. 

[13] Sentana, E., 1995. Quadratic ARGH models. Rev. Econom. Stud. 3, 77-102. 

[14] Truquet, L., 2014. On a family of contrasts for parametric inference in degenerate ARCH models. 
Econometric Th., 30, 1165-1206. 


16 


Table 1: Sample RMSE of QML estimates of Oq = (jo,^o,ao,co,do) of the GQARCH 
process in (11.311 for 70 = 0.7, qq = —0.2, cq = 0.2 and different valnes of luq, do- The nnmber 
of replications is 100 


n 

do 



t<;o=0.1 



7n 

(jJn 

(In 

dn 

Cn 

1000 

0.1 

0.091 

0.057 

0.035 

0.103 

0.035 


0.2 

0.083 

0.047 

0.045 

0.109 

0.031 


0.3 

0.071 

0.045 

0.047 

0.094 

0.043 


0.4 

0.073 

0.029 

0.054 

0.097 

0.036 

5000 

0.1 

0.031 

0.021 

0.012 

0.047 

0.015 


0.2 

0.030 

0.015 

0.015 

0.041 

0.014 


0.3 

0.028 

0.011 

0.025 

0.042 

0.013 


0.4 

0.031 

0.014 

0.053 

0.059 

0.018 




a;o=0.01 


n 

do 

7n 


O-n 

dn 

Cn 

1000 

0.1 

0.070 

0.049 

0.030 

0.103 

0.029 


0.2 

0.061 

0.043 

0.035 

0.089 

0.024 


0.3 

0.066 

0.040 

0.045 

0.106 

0.044 


0.4 

0.055 

0.042 

0.056 

0.105 

0.038 

5000 

0.1 

0.025 

0.032 

0.011 

0.035 

0.013 


0.2 

0.022 

0.028 

0.013 

0.032 

0.013 


0.3 

0.025 

0.028 

0.025 

0.046 

0.016 


0.4 

0.031 

0.031 

0.046 

0.096 

0.034 




wo=0.001 


n 

do 

7n 



dn 


1000 

0.1 

0.086 

0.058 

0.026 

0.095 

0.037 


0.2 

0.056 

0.043 

0.027 

0.084 

0.031 


0.3 

0.053 

0.039 

0.046 

0.080 

0.029 


0.4 

0.055 

0.047 

0.060 

0.122 

0.041 

5000 

0.1 

0.022 

0.033 

0.009 

0.031 

0.012 


0.2 

0.020 

0.030 

0.012 

0.028 

0.012 


0.3 

0.022 

0.032 

0.024 

0.038 

0.014 


0.4 

0.032 

0.037 

0.046 

0.098 

0.031 


17 














